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Abstract 

(N 

Cn We consider variations of the Rudin-Osher-Fatenii functional which are particularly 

^__^ well-suited to denoising and deblurring of 2D bar codes. These functionals consist of an 

r \ anisotropic total variation favoring rectangles and a fidelity term which measure the L^ 

/^ distance to the signal, both with and without the presence of a deconvolution operator. 

^^ Based upon the existence of a certain associated vector field, we find necessary and 

i-G sufficient conditions for a function to be a minimizer. We apply these results to 2D bar 

d codes to find explicit regimes - in terms of the fidelity parameter and smallest length 

C scale of the bar codes - for which the perfect bar code is attained via minimization 

I— ^ of the functionals. Via a discretization reformulated as a linear program, we perform 

numerical experiments for all functionals demonstrating their denoising and deblurring 

^^ capabilities. 

'^ Key words: anisotropic total variation, L-'^-approximation, 2D bar code, denoising. 



deblurring 
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,__! 1 Introduction 

. ^H In this article we study the application of total variation-based energy minimization for 

^ denoising and deblurring of 2D bar codes. A 2D bar code is a collection of non-overlapping 

^ black squares, the lengths of whose sides are all bounded below by some value a;, placed on 

a white backdrop. Analogous to the terminology for ID bar codes, we call the lower bound 
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Figure 1: Examples of 2D bar codes: on the left is a stacked bar code while the other two 
are examples of matrix barcodes. The matrix code on the right is an example of a QR 
(Quick Response) barcode designed to be readable with camera-equipted smart phones. 



Lo the X-dimension of the bar code. Examples include stacked and matrix 2D bar codes 
illustrated in Figure 1 (see [22] for a thorough description of 2D bar code symbologies) . 
When these bar codes are scanned, the resulting signal will be a blurred and noisy version 
of the original bar code. Efficient and robust techniques to recover the original bar code 
are needed to retrieve the information from the code. 

The problem of denoising and deblurring images via variational methods has received 
much attention in the literature since the introduction of the Rudin-Osher-Fatemi (ROE) 
functional in |24j . This functional is the sum of a so called fidelity term, which measures 
the L^ distance between the argument of the functional u and the given (measured) signal 
/, and the total variation of u, which acts as a regularization term. In this paper we will 
study variations of this functional that take into account the a priori knowledge that the 
original image which we want to recover is a 2D bar code. 

Here we consider three functionals based upon a particular anisotropic total variation 
well suited to 2D barcodes. It is defined for all u £ BV{R^) (cf. ((2l|) as 



/ |na;| + |uy| := sup < / u divu : v G C^ (I 

yR2 [J ^2 



I'), 



Vx |u(x)|oo < 1 



(1) 



where for a vector v{x) = {vi{x), V2{x)) G M?, the norm | • |oo is defined by 

b(a;)|oo := max{|ui(x)|,|f2(a;)|}. 

This notation should not be confused with the L°° norm of a vector field v £ L°°(M^;M^), 
denoted by HvHoo) which is the supremum of |f(x)| over all x G M^ where | • | denotes the 
standard Euclidean norm. 

Let / G L^(]R^) denote an observed signal and A > be the so-called fidelity parameter. 
We consider the following functionals. 



• 



Denoising: 

Fi{u) := / \ux\ + \uy\ + A||n — fWi'^m^) defined for u G BViM"^). 
Jr-2 ' 

Minimizing this functional includes no deblurring effects but the regularizing effect 
from the anisotropic total variation will lead to denoising. 

Denoising and slight deblurring: 

F\{u) := \ux\ + \uy\ + \\\u- f\\Li(^2) defined forneSy(M2; {0,1}). 

Note here the smaller domain of binary functions which entails a very crude attempt 
at deblurring. Whereas the functional is no longer convex over its domain, it has a 



convenient convex reformulation (cf. Lemma 5.1) via the following functional: 

F2{v) := / l^^l + \vy\ + X [ (|1 - /I - I/I) V defined for v G BViR^; [0, 1]). 

• Deblurring and denoising: 

F3(m) := / \ucc\ + \uy\+ \\\Ku- f\\Li(^2) defined for u E Sy(M^). 

Jr2 

Here 

K : L (M ) — 7- L (M ) is a positive normalizedj bounded linear operator, (2) 

e.g. convolution with a suitable blurring kernel which is commonly referred to {cf. 
[7]) as the PSF {point spread function). Our main interest here is when / is of the 
form / = Kuq, where uq G BV{M?), and in particular where uq is the characteristic 
function of a bar code (we could hence consider the larger class of operators K defined 
on BV{M?)). The linear operator K models the blurring of the bar code signal and 
deblurring is introduced by the action of -fC on u prior to comparison with /. 

These functionals are variations of the original ROF functional with the following mod- 
ifications: (i) The standard isotropic total variation of a characteristic function u G 
BV{M?, {0,1}) gives the length of the perimeter of the set {u = 1}. Using this as reg- 
ularization term will lead to a rounding off of corners in the end result, because a rounded 
off corner has less interface than a sharp one. Our aim is to recover bar codes with sharp 

H.e. 1^2 Ku = ^2 w 



corners and hence we use this particular anisotropic total variation in Fi whose correspond- 
ing Wulff shape (e.g. [25], [l2]) is a square. The anisotropic total variatioijj we use gives, 
for a characteristic function u, the sum of the lengths of the projections of the perimeter 
of {u = 1} onto the coordinate axes. Moreover, it allows one to reformulate the discretized 
minimization problems in the form of linear programs which can be computationally solved 
quickly and efficiently (see Sectional), (ii) For the fidelity term we use the L^ distance. As 
addressed in [5] the use of an L^ fidelity term, as in the ROF functional, leads to a loss of 
contrast when minimizing over all of BV{E?). 

From the point of view of image processing, the usefulness of this variational approach 
lies in the ability to denoise and deblur signals via minimization of the functionals. This has 
the potential to work well if the functionals are in fact faithful to the underlying images 
sought in the sense that if we input a perfect signal, minimization of the appropriate 
functional will indeed yield back the perfect signal. We will say a functional Fi, i E {1,2} 
is faithful to a signal / i/ there exists some explicit regime for A such that the signal / is 
the unique minimizer of Fi. We say F^ is faithful to a signal uq i/ there exists some explicit 
regime for A such that uq is the unique minimizer of F^ with / = Kuq. We thus focus on 
the following four questions: 

1. If the parameter A is chosen too small the lack of enforced fidelity to the measured 
signal will lead to the trivial minimizer u = 0. For which values of A is this the case? 

2. Are the functionals faithful to a clean 2D bar code and what are the associated values 
of A? How do these threshold values for A depend on the X-dimension of the bar 
code and the properties of the blurring operator K? 

3. Are the Fi faithful to other binary signals? This is particularly relevant to judge the 
denoising properties of our functionals: if only clean 2D bar code signals are returned 
unchanged by minimization, this is an indication that noisy bar code signals will be 
denoised. 

4. What do numerical simulations for minimization of these functionals yield? Particu- 
larly, how do these minimization algorithms perform in the presence of noise? 



Question 1 is answered in Lemma [2. 2[ The basis for answering questions 2 and 3 lie in 
the existence of a certain vector field (cf. the definition of V in ([3])). Following an argument 
initially presented in [19] , and elaborated on in [5j , we find that a sufficient condition for uq 



to be a minimizer is the existence of a vector field v £ V{uq) (cf. Theorem 3.2 ). Arguments 



^ Our choice of an anisotropic total variation does have a significant drawback: with the anisotropy 
along the coordinate axes, it assumes that the measured bar code is aligned with the coordinate axes (see 
also the definition of bar code in Section ffl. In practice this assumption does not necessarily hold and the 
bar code might be rotated or even seen from a skewed perspective. Either a preprocessing step which aligns 
the bar code with the axes or the use of a rotated form of the anisotropic total variation might be in order 
(e.g. [3I21I1B]). 



show that the existence of such a vector field is also a 



from convex analysis ( [TOl 
necessary condition (cf. Lemma 3.1). We then use the sufficiency, and a particular vector 
field construction, to show that if A > -, a barcode z is the unique minimizer of F\ and 
F2 with / 



z (cf. Corollaries 4.2 and 5.5). If K represents convolution with any positive 
kernel (PSF) of unit mass, the same condition on A insures that z is the unique minimizer 



of -F3 (cf. first part of Theorem 6.5). We use the necessity to answer question 3: the only 



binary signals / which F\ is faithful to are clean 2D bar codes (cf. Lemma 4.4) and the 
only binary signals uq which Fj, with / = Ku^ is faithful to are bar codes (cf. second part 
of Theorem 6.5). Question 4 is discussed in Sections [7] and |8J 

Because of the importance these vector fields play in our analysis we introduce special 
notation for them (compare with the extremal pairs in [ 19t Section 1.14, Proposition 5]). 
For a fixed u G BV{M?) we define 



V{u) := {v € L°^(M ;M ) : the three conditions below are satisfied} 



(3) 



where the three conditions are 

1. |t^(a;)|oo < 1 for almost all x £ M^, 

2. divuG L°°{R'^), 

3. -J^2udivv = J^2\u^\ + \uy\, 

There is an increasingly large literature on the analysis of these types of functionals 
(c/. [7]) and indeed, our work is highly guided by similar work of Chan, Esedoglu, Meyer, 
Osher, Ring, and others fMl [13 O El [23] ■ We are unaware of any analysis on this particular 
combination of L^ fidelity and anisotropic total variation. 



2 Trivial minimizer 

We first state an elementary lemma involving the operator K. Its proof easily follows by 
decomposing u into its positive and negative parts and using the triangle inequality. 

Lemma 2.1. Let u G L^{M.'^), K he as in M), and f] C M^ he open, then 



u 



< 



\Ku\ < 



Lemma 2.2. Let there be an R > such that supp / C B{0;R) and define Aq := 



C 

where C is the isoperimetric constant from Lemma A. 2. If < X < Xq then u = is 
the unique minimizer of Fi and Fi. If in addition kei K = {0} then u = is the unique 
minimizer of F3 as well. 



Proof. The proof is essentially the same as that of [5, Proposition 5.7]. Since it is brief, we 
present it for F^. Let u be a minimizer of F3 and hence F^^u) < Fs^O). By Lemma A. 2 we 
find 



clf uA +x[ \Ku-f\+x[ \Ku\ 

\Jb{Q;R) J Jb{0;R) J B{0;B)'' 



1 



<C{ u^] +X \Ku-f\< \u^\ + \uy\+X \Ku-f\ 

\JR2 / JIR2 J^2 J^2 

<FsiO) = X f \f\ = X f \f\<xf \Ku-f\+x[ \Ku\. 

JR2 Jb(0:R) Jb(0:R) J B(0:R) 



'B{0;R) JB{0;R) J B{0;R) 

Lemma 2.1 and Holder's inequality tell us that 

/ \Ku\ < \u\< Ry/ir 

Jb{0;R) Jb{0;R) \J B{0;R) 

Applying this to the left hand side of the calculation above we get 





(Ao - A) / \Ku\ + X / \Ku\ < 0. 

Since A < Aq, j^2 \Ku\ =0. □ 

3 Minimizers of Fi 

We first explore the consequence of the simple property in convex analysis that (cf. [TO]) 
for a convex functional F defined over a topological vector space V , 

uq is a minimizer of F over V <;=^ G 9F(uo), 

where the subdifferential of F at uq {F{uo) < cxd) is defined by 

dF{uo) :={u* eV* : y v e V, v'{u\v-uq)v + F{uq) < F{v)} . 

Here V* denotes the topological dual space with pairing v*{'i')v- 

There are some subtleties involved in choosing the right space V to define our func- 
tional(s) on. Our choice here is to take V = BVlM."^). This has the advantage that it allows 
for some basic subdifferential calculus but forces us to work with the dual space BV(U.'^)* 
and its associated pairing with BV{'R.'^) which both lack a simple general explicit descrip- 
tion. However, we only need this dual space structure in a specific case in which we are able 
to give an explicit description of the dual element and its action on smooth functions in 

6 



BV{M. ), see (10). An alternative approach would be to take V = L {M. ) after extending 



all our functionals to L^(M^) by setting their value to be +00 on L'^ {R'^)\BV {M?) . For the 
anisotropic total variation by itself, this would work well and for example, its subgradi- 
ent over V = L'^iJR.'^) was calculated in j20] Theorem 12]. However, the L^ fidelity term 
then lacks the necessary continuity properties to be treated separately and we would need 
to compute the subgradient of the functional as a whole. Defining the functionals over 
L^(M^) would solve this issue, but would still leave us with a complication in the compu- 
tation of the subgradient of the anisotropic total variation because the gradient operator 
is not continuous on L^(]R^). 

We introduce some notation. Let A^2(IK^) denote the set of all vector valued Radon 
measures on M? with two components. Denote the transpose of the gradient operator 

V : BV{R^) ^ M2{R'^),u^ {diu,d2u) 

by 

V* : A^2(M^)* ^ BV{R^)*. 

Note that since L^(]R2;M2) C A^2(M^) we have A^2(M^)* C L'=^{R'^;R'^). Foi a v £ M2(R'^T 
and fi G A^2(IR^) we can write the coupling as J^^ v dfi. In particular if /x is absolutely 
continuous with respect to the Lebesgue measure we can identify /x via the Radon-Nikodym 
derivative with a function in L^(R^;]R^) which we again denote by /i. In that case the 
coupling with v can be written as f^2 v • /i dC'^ (we will leave dC^ out where there is no 
confusion) . 

Furthermore we introduce 

II • ||a:X2(M^) ^M,/i^sup| / vidfii+ I V2dfi2 : v e C^{M.'^),\/x, \v{x)\o^ < 1 
(where we interpret J^2 Vi ddiU = — J^2 udiVi dx for u G BVi^^)). Note that 

||Vu||a = / |na;| + \Uy\. 



Lemma 3.1. If uq G BViR?) is a minimizer of Fi over BV{R?), then there exists a vector 
field V £ V{uq) and A > ||diui;||j;^oom2). 

Proof. This proof follows similar lines as the proofs of [U, Theorem 2.3] and [23, Proposition 
3]. Note that the result is trivially true if uq = 0. We explore the consequences of 
E dFi{uQ). Because both terms in Fi are continuous in u, the subdifferential dF{uo) is 
given by the sum of the subdifferentials of the separate terms |10t Chapter I, Proposition 
5.6]. 

The functional u 1— )• J^2 \ux\ + |%| can be written as the composition: || • ||aO V. Because 
II • ||a is a continuous functional on A^2(l^^) and V is a continuous linear mapping from 
BV to M2{R'^), we can apply [TUl Chapter I, Proposition 5.7]: 

5(||-||aoV)(no) = V*a||-|U(Vno). 
7 



This means that 

X e 5(11 • \\a o V)(no) <^ 3t; G d\\ ■ ||a(Vno) such that x = V*w. 

Note that since L1(M2;M2) c X2(K^) we have d\\ ■ ||a(Vno) C M2{^^)* C L°°{m?]m?) and 
hence v G L°^(M^;]R^). Because uq £ BV{^) and hence ||Vno||a is finite, the subdifferen- 
tial d\\ ■ ||a(V«o) is characterized by 

ved\\ •||a(Vno)^V^iGA^2(K2) A^2(ffi2)-(^',Ai-VMo)A^2(R2) + ||Vuo||a < ||^||a- (4) 

Next we turn to the subdifferential for the fidehty term in Fi. First note that since 
VF^'HM^) C BV(E?) we have 5 (/jga | • -/|) (-uq) C ^^(M^)* c W^^^i^^)*. Since the 
fidelity term in Fi is finite for u = uq & BVi^), the subdifferential is determined by 

ijed( \--f\]{uo)^yueBViR'^) BViR^)*{i^,u-uo)Bv{R^)+ \uo-f\< \u-f\. 

(5) 
We deduce that there exist v and ip as above such that 

V*v + AV' = 0. (6) 

Choosing fi = and /x = 2Vuo in the right hand side statement of Q leads to 

-X2(iR2)*(^^>Vno)A^2(iR2) < -IIVmoIU and X2(IR2)*(^^> Vmo)x2(m2) < l|Vno||a, 
hence 

A42(M2)*(«,Vno)^2(IR2) = ||Vuo||a- (7) 

Substituting this back into ^ gives, for ah fi G 7^2(1^^), 

M2(IR2)*('y)/^)A42(IR2) < ll/^IU- 
If we restrict this to fi = {fJ,i, ^2) G L^(M^;M^) this reads 



JR2 

and hence |i'(x)|oo < 1 almost everywhere, i.e. condition IT] in ([3]) holds. 

Let u G BV{M?) and choose u = ztu + uq in the right hand side statement of (pi) (and 
then drop the tilde), then we get that for all u G BV{M?) 



.(^,u)By(K2) < / I-U]. (8) 

JR2 

We use (|8| to show that there exists an L°°(M?) function such that the action of ip on test 



functions is given by integration against this function. To this end, note that ip G PF ' (M ) 



and hence by [1'^ 3.4 and Theorem 3.8], there exist {p, q) G L°°(E?) x L°°(M?;M?) such that 
for allue VF^'HM^) 



BV(R2y{'4^,u)Bv(R2)= / pu+ q-Vu. 

Fix u G C^(M^) and y G M^. For e > define Us{x) := e^'^u{e^^{x — y)) and use this as u 
in (Is]) to find via a substitution of variables 

/ p{ex + y) u{x) dx + e'^ / q{ex + y) ■ V u{x) dx < l \u{x)\dx. 

JR2 J]R2 J]R2 



Because 



p(ex + y) u{x) dx 



I q{ex + y) ■ Vn(x) dx 

JR2 



taking the hmit e — )• we deduce that 



— \\p\ 



< lkllL° 



[""IIli 



iVul 



hm / q{£x + y) ■ \7u{x) dx = 0. 



We claim that the above implies q = a.e. To see this note that since u, and hence Vti, 
have compact support, we can replace, for e small, q hy q := q\y+suppu in the preceding 
integral. We have, for any p > 1, q € L'P{M?;'M?) and hence there exists a sequence 
{qn}n=i C C^(M2;M2) such that g„ ^ ^ in LP{R'^;M?). Via Holder's inequality we find 
that 

= lim / q{ex + y) ■'Vu{x) dx = lira lim / qn{ex + y) ■'Vu{x) dx. (9) 

£^0 7j52 e^On^oo J^2 

Since {qn}^=i is a compact set of continuous functions defined on a compact set by the 
Arzela-Ascoli theorem it is equicontinuous and hence 

/ qn{^x + y) ■ Vu{x) dx ^>- qn{y) ■ Vu(x) dx, uniformly in n as e — )• 0. 

Jr2 J^2 

This allows us to interchange the limits in Q and find 

lim lim / qn{ex + y) ■Vu{x) dx = lim lim / qn{ex + y) ■Vu{x) dx. 

e—^O n— ^oo J^2 n— >-oo £—>-0 _/jj2 

We now apply the dominated convergence theorem to find that 

lim lim / qn{ex + y) ■'S/u{x) dx = lim / qn{y) ■Vu{x) dx. 



Because L^ convergence implies pointwise convergence almost everywhere and qn{y) does 
not depend on the integration variable x, we conclude that for almost every y G M^ 



lim / qn{y) ■ Vu(x) dx = q{y) ■ Vn(x) dx = q{y) ■ 'Vu{x) dx = 0. 

"^°° 7R2 7r2 7k2 

The function u was chosen arbitrarily, hence q = Q a.e. and we conclude for all u G C^l^), 

bv{m?)*{'^^u)bv(9?)= I pu. (10) 

JR2 

We thus have p = ip in the sense of distributions, and hence by equation ([6]), there exists 
r G L°°(M^) which as a distribution may be identified with V*v such that 



BV 



y{V*V,u)BV{R^) = ru. 

JR2 

Since for every ip £ C^{R'^), 

Jr-2 
= -By(M2).(V*t;,v3)By(i82) = - / rip, (11) 



we have — divf = r G L°°(M^) in the sense of distributions. This gives condition p^ in ([3|). 
Also by equation ([6]): — divu + Xip = 0, in the sense of distributions. 
We remember that we can write ([7]) as 



v-dVuo = / \uoJ + |tioJ. 

JR2 

For (j) G C^1(M2;M2) we have, [3 equation (3.2)], 

dVuo = — / ^io div (/). 



/ 



The vector field u satisfies all the conditions of Lemma A.3| and hence there exists a sequence 



{vj}JL^ C C^{R'^;R'^) such that as j -^ oo, Vj -^ v in L'^{R'^;R'^), and divvj ^ div?; in 
L°^(M2). We compute 



/ 



uq div V = — lira / nodivT;j= lim / Vj ■ dVuQ. 



From ||vj||^oom2) < C and Vj G C^(M^) we deduce that maxfj(x) < C. Since uq G BV{R'^) 
we have that — oo < Vno(M^) < oo and hence the constant function C is integrable against 
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the measure Vuq. Because Vj{x) — )• v{x) almost everywhere the dommated convergence 
theorem tells us 

lim / Vj ■ dVuo = v ■ dVuQ, 

from which we conclude that condition^ in ([3]) holds. 

Finally, combining Q, ([6]), and the fact that V as distribution is represented by an 
L°°(R2) function, we have by density of C^{R'^) in L^{R'^) that for every u e P{R'^) 



udivv = A/ uil} <\ I |ii|, (12) 

JR2 J ^2 J ^2 

and therefore A > ||divt;||^oo(ig2). 

□ 

Theorem 3.2. Let f £ BV{R?) be the measured signal in Fi, then the following two 
statements are equivalent: 

1. f is a minimizer of Fi over BV{R3). 

2. There exists a vector field v G V(/) and A > Hdiw ||j;^cx)(ir2). 

Moreover, if there exists a vector field v £ V(/) and A > || diwH 2, 00(1^2 ), then f is the unique 
minimizer of Fi over BV{M?). 

Proof. The implication [T] =^ [2] follows directly from Lemma |3.1[ For the reverse direction, 
we follow ^ Lemma 5.5]. To this end, for any u G BV{R?) Corollary A. 4 implies 



\ux\ + \uy\ > — udivv 



and hence 



Fi{u)>- j udivv + X \u-f\ 

Jr'2 yR2 

= — / f divv + A / \u — f\ — {u — f) divf 

Jr2 yR2 Jm.2 

> -^i(/) + (A- ||divt;||ioom2)) / \u-f\ 

JM2 

>Fi{f). 
If A > ||divt'||2,oo(]R2), the last inequality is strict. □ 
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4 Fi and 2D barcodes 

We define some further notation to make the idea of a 2D bar code precise. By a 2D 
bar code we mean a bounded set S* C M^ such that dS is the union of a finite number of 
non-intersecting polygons, each a union of horizontal and vertical line segments. For s G M, 
define the horizontal and vertical lines 

Ihis) := {x eM"^ : X2 = s} , k{s) := {x GR"^ : xi = s} . 

For given s G M let ujj^{s) be the width of the shortest connected component of lh{s) n S 
and iof^is) the width of the shortest connected component of lh{s) n S"^. Analogously define 
ujv' for the connected components of lv{s) Ci S and lv{s) Ci S'^. We define the X-dimension 
of S to be 

uj := mm {u;l{s),ujl{s),u}lis),ujl{s)}. 

In words: The X-dimension is the shortest horizontal and vertical length scale of both the 
black squares and the white background. We denote the set of 2D bar codes by S and 
the set of 2D bar codes with prescribed X-dimension larger than or equal to uj by Si^. 
We identify the 2D bar codes with their characteristic functions {xs is the characteristic 
function of the set S) : 

B:= {uG BViR^; {0, 1}) : there is an 5 G 5 such that u = xs} , (13) 

Btu '■= {u G BV{M. ; {0, 1}) : there is an S" G S^ such that u = xs} ■ 

By d^:S we denote the reduced boundary of a set S, i.e. all points in dS for which there 
is a well defined normal vector (see [21 Definition 3.54]). For example, if S* is a square its 
reduced boundary consists of all boundary points except the corners. 

Theorem 4.1. Let S G S^^. Then there exists a vector field v G V{xs) with \\divv\\i^a 



Proof. Let n(x) be the outward normal to 5" at x G (9*5* and define the following subsets 
of a 5: 

V± ■= {x G d^S : -n(x) = (±1, 0)} , H± := {x G d^S : -n{x) = (0, ±1)} . 

Let V := V^U V+ and H := H^ U H+ {V U H = d^S). See Figure [2] for an illustration. 
For each s G M, if lh{s) H V and lv{s) n H are nonempty, they are finite sets of isolated 
points. Furthermore, if we write lh{s) CiV = {x^^', . . .x^^"^} where xf < x^ for all 
i, then x^^' G V+ for odd i and x^^' G V- for even i. The analogous statement holds for 
lv{s) n H. By definition of uj we have 

Vx, y G Ihis) riV, \xi — yi\ >uj and Vx, y G lv{s) n H, |x2 — ^2! > ^- (14) 
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Figure 2: A possible choice for S in Theorem 4.1 with the boundary parts V± and H± 
indicated as well as the length uj. 



For each such s G M, fixx^*^-*, x^^"^^^' € lh{s) such that \x\ —x^ \ > oj and \x\^ 



(2n) (2n+l)| 



> 



UJ. 



We define vi G L^{M?) with compact support as follows. For each s G M for which 
lh{s) n y = 0, let fi(-, s) = 0. For each s G M for which lh{s) fl F is not empty, vi{-, s) is 
defined by: 



linear on each interval 

vi{x) = 



» Ji+i) 



X 1 . X 



1 '-^1 



for i = 0, . . . , 2n, 



-1 iixeV-, 

1 [fxeV+, 



„(o) 



n 



(2n+l) 



,CXD . 



dvi 
dxi 



L°°(M2) 



The function vi{-,s) is Lipschitz continuous for each s G M and 

We define V2 G L°^(M?) in a similar way on each vertical line /^(s). In particular V2{s, •) is 
Lipschitz continuous for each s £ R and satisfies 



V2(X 



-1 if xGi?-, 
1 if xG-H'+, 



with 



dvo 



dX'2 



2 



Now for V := (1^1,1^2) € L°°(M"';M"') we have |u(a;)|oo < 1 for a; G W. We compute 



divu 



V ■ n 



d,S 



Vl 



V2+ ^1 + / V2 

H_ Jv+ Jh4 



I 1+ I 1+1 1+1 i = n\d,s) = n\ds) 

JV- JH- JV+ JH+ 



I A.6x I "*" l/Coy I 
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We have divv G L^ 



with 



I div V I 



L°° 



< 



dvi 



dxi 



+ 



dvo 



dxo 



4 

a; 



□ 



Corollary 4.2. Lei / G B^i be the measured signal in Fi. If X > — (X > —), then u = f 
is a minimizer (the unique minimizer) of Fi over BV{^). 



Proof. This follows directly from Theorems 3.2 and|4.1 



□ 



Remark 4.3. In the case where 5 is a single square one can adapt the vector field 
construction in [12l Theorem 4.1] to our situation to get a different vector field v G V{xs)- 
In this case one finds the same bound on A since ||divu||^o 



Corollary 4.2 tells us that Fi is faithful to clean 2D bar codes. Lemma 4.4 below 
answers negatively the reverse question: Is Fi faithful to any other choices of binary /? 

Lemma 4.4. Let f G i?y(M^; {0, 1}) be both the measured signal in Fi and a minimizer 
ofFi over BV{R'^), then f eB. 

Proof Note that if / = the result is trivially true. We now assume that / 7^ 0. We prove 
this via contradiction. For some A C M.'^, A ^ S, let f = XA ^3. By Lemma A. 8 there 



exists a sequence {Aj}"^^ of open sets with smooth boundaries converging in measure to 
A such that 

lim n^{dAj) = n^{d^A) and 

j-s>oo 



lim 

j-s>oo 



\XA,J + \XA,J 



\XaJ + iXAy 



Since A ^ S, d^^A contains a non-horizontal and non-vertical curve of positive 7i^ 
measure. In other words, there is a connected subset B C 9* A such that 'H^(S) > and 
the generalized normal vector (cf. [21 Definition 3.54]) to d^:A satisfies |ni| < 1 and |n2| < 1 
almost everywhere on B. Then for every j there is a connected subset Bj C dAj such that 
T-l^{Bj) is uniformly bounded away from zero and the generalized normal vector n^ to dAj 
satisfies the same inequalities as above. We denote the extensions of the normals n^ into 
smooth vector fields on M? with compact support by n^ as well. 

Let d' G C^{Bj) be a non-negative function such that Kl + o')?!!! < 1 and |(l-|-c-')n2| < 
1 almost everywhere on Bj. Then o' is uniformly bounded away from zero on a subset 
B* C Bj of positive 7i^ measure. Let w^ G Cl{M?;M?) be such that |ii;-^(x)|oo < 1 for all 
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X, w- 



n on dAj \ B* and w^ = {I + c>)n^ on B*. Then 

n^{d^A) = lim V}{dAj) = lim / n^ ■ n^ = lim I n^ -71^+ [ 

i^°° i-^°° JdAj i^°° JdAj\B* Je 

< lim / n^ ■ n-' + cPn^ • n^ = lim / w-' ■ n^ = lim / XA divw 

3^°° JdA, Jb* i^°° JdAi i^°° Jr2 ^ 



ldAj\B* Jb* 



^ i™ / . \^AjJ + I^^.J = / . I^^-I + I^^J- 



J-!>00 lm,9. ^^ ■'!' 



Because / minimizes Fi over i?y(R ) we know by Theorem 3.2 that there exists a 



vector field v e L°°(]R^;M^) such that for almost ah x e M^, |t;j(x)|oo < 1 and 



[ \fr\ + \fy\= I 
Because |n(x)|oo < 1 and |u(a;)|oo < 1 almost everywhere on B we find 



V ■ n. 
ld*A 



v-n< vin\ + V2n\< i max(fi,f2)(^i + "-2) ^ / 1 = 'H^(9*^). 

9* A Jd,A J a, A J a, A 



Hence we deduce 



n\d,A)< [ \M + \fy\<n\d,A) 



which is a contradiction. □ 

5 Minimizers of Fi and F2 

Next we investigate minimizers of Fi. Due to the binary constraint on admissible functions, 
the minimization problem is no longer convex. However, following Chan and Esedoglu [5] 
(see also [6] ) there is a simple and elegant convex reformulation of the problem. 

Lemma 5.1. If v £ BV{M?; [0, 1]) is a minimizer of the convex functional 
F2{v):= [ \v,\ + \vy\ + X [ (I1-/I - \f\)v, 



then for a.e. t G [0, 1], u = XE(t) ^^ cl minimizer of Fi over BV{M?; {0, 1}) with the same 
A where 

E{t) := {xGR^ : v{x) > t}. 

Proof. The proof is essentially a repetition of [HI Theorem 2]. Let v G BV{M?; [0, 1]) be a 
minimizer of F2. Because 

v{x) = / X[o,v{x)]it) dt = / XE(t){x)dt 
Jo Jo 
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we compute 



convex 
u 



f {\l-f\-\f\)v= [ I {\l-f\-\f\)xE(t)dtdx= I I {\l-f\-\f\)dxdt 
Jr2 J]r2 Jo jo JE{t) 

= [[ f \^-f\-[\f\+f \f\]= til \XE(t)-f\)-C, 

Jo \JE{t) yR2 JE{ty J Jo \Jm? J 

where C does not depend on v. Hence together with Lemma A. 7 we can now write 
F2{v)= f ( f \xEit)J + \XE(t)J + a/" \xEit) - f\) - >^C = f F[[xE(t))-\C. 

Jo \JIR2 Jk2 J Jq 

Since u is a minimizer of F2, we find that for almost every t G [0, 1], XE(t) is a minimizer 
of i^. 

□ 

We now turn to minimizers of F2. In order to stay within the general framework of 
...vex analysis, we have to define our functional on a vector space. Thus we define for all 
G BViR"^), the functional 

F2{u) := F2{u) + Ci?y(M2;[o,i])(n), 

where for a given set A, the Ca is defined as 

. . ^ _ J if a; G ^, 

U[x) :- j ^^ iixeA^. 

Note that minimizing F2 over BV{M.'^) is equivalent to minimizing F2 over BV{M.'^; [0, 1]). 
We will now formulate results that tell us which conditions are necessary and/or suf- 
ficient for u G BV{M?) to be a minimizer of F2. First we address the implications from 
convex analysis for minimizers of F2. 

Lemma 5.2. uq G BV{M?) is a minimizer of F2 over BV{M.'^) if and only if uq G 
5y(M^ [0, 1]) and there exists v G L'^(M?;R'^) satisfying 

V^gX2(M^) >!2{i:2).(^^,At- V'Uo)a42{k2) + llVnolla < IImIU (15) 

and in addition there exists ^ G BV{M.'^)* such that 

Vn G BV{R^; [0, 1]) BV{R^r (C, u - uo)BV{m ^ ^ 

and 

V*t; + A(|l-/|-|/|)+e = 0. 
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Proof. Following Lemma 3.1 , we consider the consequences of G dF2{uo), focusing on each 
of the three terms separately. The continuity of F2 ensures that even though Cbv(R^;[o,i]) 
is not continuous with respect to the topology on BV{M.'^) we can still use ^0\ Chapter I, 
Proposition 5.6] to compute the subdifferential of each term separately and then add them 
to find dF2{uo). 

The subdifferential of the functional BV{M?) — t- M : n 1— >■ J^^ \ux\ + \uy\ was analyzed 
in Lemma |3.1| where we found that x ^ ^(11 " lU ° ^){^o) if ^-i^d only if x = ^*v for a 
V G L°°{R'^~W) satisfying 

V/i G A^2(K^) A^2(K2)*(^,/^- Vuo)^2(]K2) + IIVuolU < Wf^Wa- 

Since the second term in F2, i.e. the functional BV{M.'^) — t- M : n 1— t- Jj^a (|1 — /| — |/|)^; is 
Gateaux differentiable, we find (cf. |10| Chapter I, Proposition 5.3]) that its subdifferential 
is the singleton {(|1 — /| — |/|)}. To be precise, the subdifferential at uq has exactly one 
element ij: which satisfies, for all u £ BV(M?), 



y{i;,u)BviR^)= / {\l - f\ - \f\) n. (16) 

Turning to the last term in F2, we have 

^ e 5Ci?v(M2;[o,i])(no) «4> Cbv{i;2;[o,i])('Uo) < 00 and Vu G BViR^) 

BV(R2).(C,U - Uo)bv{R2) + CbV'(R2;[o,1])(w.o) < CBy(R2;[0,l]) (^)- 

The condition C_BV'(iR2;[o,i])(''io) < 00 is equivalent to uq G BV{M?; [0,1]). For such uq we 
have Cbv{m^^:[o,i]){^o) — and thus the second condition becomes 

VnG By(R^)By(K2).(C,u-Mo)BV'(R2) < Ci3y(R2;[o,i])(n). 

For u G BVi:W?)\BVi:W?; [0, 1]) this condition is trivially satisfied, while for u G BVi^^; [0, 1]) 
we have C_bv(r2;[o,i])(^) = 0- We deduce 

i e 9Cw(R2;[o,i])K) ^ ^*o G 5F(M2; [0, 1]) and Vu G ^^(M^; [0, 1]) w{R2)*(C, ^-^0)5^(^2) < 0. 
Adding the three computed subdifferentials gives the result. □ 

Remark 5.3. It is instructive to note that if u G BV{^\ [0, 1]) is a minimizer of F2 the 
condition 

v*^ + A(|i-/i-i/i)+e = o 



from Lemma 5.2 does not allow us to conclude that V*f = — divf G L°^{^^., as we could 



conclude in Theorem 

We now turn to a sufficient condition for li to be a minimizer which can be adapted to 
deal with binary u as well. Here more regularity on the vector field is required as explained 
in the next lemma, which is based upon [12, Proposition 3.3] and [5, Lemma 5.5]. 
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Lemma 5.4. uq G BV{M?) is a minimizer of F2 over BV{M?) if uq G BVCE?; [0, 1]) and 
in addition there exists a vector field v G V(no) and for all u G BV(M?; [0, 1]) 



I ^(^divv-X{\l-f\-\f\)){u-uo)<0. 



(17) 



If the inequality in (11) is strict, uq is the unique minimizer of F2 over BV{M.'^). 



Proof. Because uq G BV{M.'^; [0, 1]) we have -^2(^0) = F2{uo) < cxd. Therefore we have to 
show that F2(no) < F2{u) for all u G BV{R'^;[0,l]). By ([l7| and condition [s] in ^ we 
compute 



Fo(u) 



[ \u,\ + \uy\+X [ (|l-/|-|/|)n 

\ux\ + \uy\ + {uq- u){divv - A(|l - /I - l/D) 

yiR2 

+ / uo(A(|l-/|-|/|)-divt;)+ / ndivt; 

Jm.2 J^2 

> / In^;! + l-Uj;! + / udwv+ / no(A(|l - /I - I/I) - divf) 

JR2 J]R2 Jlg2 

= / \ux\ + \uy\+ udivv+ \uoJ + \uOy\+^ uo{\l - f\ - \f\) 
= / l^ixl + |ii?/| + / udivv + F2{uo) 

7R2 J^2 

> F2{uq). 

The last inequality follows since by Corollary |A.4 we have 



\Ux\ + \Uy\ > 



udivv. 



If the inequality in (17) is strict, then so is the first inequality in the computation above, 
and hence ^2(1^0) > F2{u). □ 

Corollary 5.5. Let f ^ B be the measured signal in Fi. Then f is a minimizer of Fi over 
BV(E?; {0, 1}) if there exists a vector field v G V(/) such that 



A > max {-divv\suppf, divv\(^s^ppfy) 



(18) 



// the inequality in (18) is strict, then f is the unique minimizer of Fi over BViM. , {0, 1}). 



Proof. First we use Lemma 5.4 to prove that / is a minimizer of F2 over BV(^), and 
hence of F2 over BV(^] [0, 1]). It then follows from Lemma 5.1 that / is also a minimizer 
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of Fi over BV(M?;{0,1}). To this end, we show that the conditions of Lemma 5.4 are 
fulfilled with no = /. Most of them follow directly, only (17) in Lemma 5.4 needs some 
explanation. Let w £ BV{M?; [0, 1]). Since f £ B we have 



I1-/I-I/I 



on supp /, 
on (supp/)^. 



and w — f 



< on supp/, 
> on (supp fY 



Because A > max (— divz;|supp/, divw|(supp/)=) we find 
X{\l-f\-\f\)){w-f) = 

{div V + X) {f - w) + 



/ 



divv 



supp/ 



(supp/)'^ 



{divv- X){w- f) <0. 



Finally, if the inequality in (18) is strict it follows by the computation above that the 



inequality in (17) is strict as well and hence by Lemma 5.4 / is the unique minimizer of 
F2 over BV {M?). Because / is binary all its super level sets are the same and it follows by 
Lemma 5.1 that / is the unique minimizer of -Fi. 

□ 



Note that, as expected, the condition on A we found for minimizing Fi, i.e. A > 
|divf ||^oom2\, implies condition (18). One could ask whether the new condition on A 



is weaker in practice than the old one. This is only the case if dWv takes either large 
positive values on supp/ or large negative values on (supp/)'^, which is not true for the 



two examples of vector fields v we have seen in Theorem |4.1| and Remark 4.3 



6 Minimizers of F3 

Lemma 6.1. Let K be as in M). Ifuo G BV{M?) is a minimizer of F^ over BV (M."^) , then 
there exists a vector field v G V{uo) such that for all w E BV{M?), 



w divv 



< A 



\Kw\. 



(19) 



Proof. The proof is almost identical to the proof of Lemma 3.1 Here we point out the 
differences. The subdifferential of the anisotropic total variation is computed as before and 
hence the existence of a u G L°°(]R^;R^) satisfying condition [I] in (pi) follows as before. For 
the subdifferential of the fidelity term at uq, we find 



i/j G 



d( f \K--f\] (no) ^ f \Kuo - f\ < 00 and Vn G ^^(M^) 



BV(R^)*{i^,U-Uo)BV(R2) + / 1^^0-/1 < / \Ku-f\. 

Jr2 Jr2 
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Since Kuq G L^{M?), the condition / \Kuo—f\ < oo is trivially satisfied. Let w G BV{M?) 

and choose u = ztw + uq in the second inequality in the right hand side above. Then we 
compute 

±bv(r^)*{iP^w)bv(r2) + / \Kuo-f\< / \±Kw+Kuo-f\< / \Kw\ + / \Kuo-f\, 

Jm.2 JR2 J^2 J^2 



Hence by Lemma 2.1 



|sy(R2)*('^>^")By(K2)| < 



\Kw\ < 



\w\ 



(20) 



for all w G BV{M.'^). The scaling arguments following equation (|8|) in the proof of The- 
orem 3.2 now follow as before and we find that as a distribution ip G BVCR."^)* can be 
represented by V' £ L°°{M?), — divi; + Xip = as distributions, and by density of C^(M^) 
in LVm2) 



A / Tpwdx 



wdiw 



for all w G L^{E?). Combining this with the first inequality in (20) gives (19). From here 
on all the arguments follow as in the proof of Lemma |3.1[ 

□ 



in (12). 



2.1 



we have 



\Kw\ < 



Remark 6.2. It is noteworthy that (19) implies A > ||divf ||j;^oo 
Lemma 



as follows: By 



w\ and hence (19) allows us to repeat the argument 



Theorem 6.3. Let uq G BV{M?) and K he as in |M). Define f := Kuq. Then uq is a 
minimizer of F^ over BVCR."^) if and only if there exists a vector field v G V(uo) such that, 
for all w G BV{M?), (19) holds. Moreover, if such a vector field exist and the inequality in 
(19) is strict, then uq is the unique minimizer of F^ over BV{M.'^). 



Proof. By Lemma |6.1[ it suffices to prove that if the vector field v exists then uq is a 
minimizer of F^ over BV(M?). Let u G BV(M?). By Corollary A. 4 we have 



\ux\ + \uy\ ^ — ndivf. 

Jm.2 

Also note that by condition^ in (^ we have F^^uq) = — f^2 uodivv. Using these results 
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we find 



F3{u)>- udivv + X \Ku-f\ 

uodiYv + X I \Ku — f\ 

= F3(no) + A 
> Fsiuo). 



\K{u-uo)\ 



{u — uq) dWv 



(n — uo) divf 



The inequality follows directly from (19). Finally, if the inequality in (19) is strict the 

□ 



above inequality is strict: Fs^u) > i<3(uo). 

The following lemma shows that if the linear operator K is given by convolution with 



a blurring kernel/PSF, condition (19) is satisfied for A sufficiently large 



Lemma 6.4. Letuo G BV(M?) andv G V(uo). For all w G BV(M?) define Kw := k*w for 
some nonnegative kernel k G L^{M.'^) satisfying J^2 k = 1. If X > \\divv\\i^o 
(19) holds. Moreover, if X > \\divv\\i,xm2\ the inequality in (19) is strict. 



condition 



Proof. Because 



/ |A; * (iwdivw)! < ||divt;||^oom2\ / 



\k * w\ 



the convolution k * {wdivv) is well-defined. By Lemma 2.1 we conclude that 



u;divf 



< 



\k * {wdiw)\ < ||divz;| 



lA; * wl < A 



\Kw\ 



The last inequality is strict if A > ||divw||^oo 



□ 



When we compare Theorem 6.3 to Theorem 3.2, we see that there are two differences 
in the conditions on the vector field v: (i) For Theorem 6.3 condition [3| in ([3]) involves z 



instead of /, as it did for Theorem 3.2; (ii) The combined condition (|19[) on A and K from 



Theorem 6.3 is stronger than the condition on A we had before in Theorem 3.2 Hence 
with Lemma 6.4 in mind, we can transfer all the results in Section [4] which we derived for 
Fi with / G ;Ba; to i<3 with f = k * z for z & Bi^. In particular, we have 

Theorem 6.5. 1. Let z G B^, let Ku := k * u for u G BV(M?) and a nonnegative 
k G L^{MP) satisfying J^2 k = 1, and let f = k * z. If X > -, then z is a minimizer 
of F^ over BV{M?). If the inequality is strict, then z is the unique minimizer of F^ 
over BV{M?). 

2. Let uq G BVi^] {0, 1}), K as in M), and f = Kuq. If uq is a minimizer of F^ over 
BV{^^), then uq G B. 
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Remark 6.6. It is interesting to note in Theorem 6.5 that the conditions on A for recovery 
of the bar code do not depend on properties of the blurring/deblurring kernel k. In [8], we 
considered the problem of deblurring of ID bar codes. In ID there is no difference between 
our anisotropic and the regular isotropic total variation, however we did employ an L^ 
instead of L^ fidelity term. While our main focus was for deblurring and blurring kernels 
of different size, a corollary of our results was that when the two coincided (analogous 
to F3), the functional was faithful to the clean bar code for blurring kernels with modest 
supports (on the order of the X-dimension). Numerical results suggested that this bound 



on the size of the blurring kernel was not optimal. Our Theorem 6.5 can readily be adopted 
to ID barcodes, showing that regardless of the support size of the kernel (or the standard 
deviation of an infinitely supported kernel), deconvolution with the same blurring kernel 



4.1 



always recovers the barcode for A > - (via the vector field construction of Theorem 
reduced to ID) when using an L^ fidelity term. However, as we note in Section pi this 
threshold value for A is very sensitive to noise and indeed this sensitivity grows with the 
support size of the blurring kernel. 



7 Numerical Implementation 

We have numerically tested the performances of the convex functionals Fi. As convex func- 
tional, their minimization can be approximated as finite dimensional convex optimization 
problems and global minimizers of these problems can be found using standard software 
packages. We chose such an implementation because it allows us to find global minimizers 
without writing custom algorithms for each functional. This allows for convenient com- 
parison and experimentation with different functionals. In some cases, other options are 
available. For example, for the functional Fi gradient descent methods on a regularized 
functional can be used as in [5], [6]. We are not aware of direct methods for F^. 

The discretization is obtained by using standard forward finite differences and quadra- 
ture. Because of the particular form of the anisotropic total variation, each of the problems 
can be reformulated as a linear program, which is usually more tractable than a general con- 
vex optimization problem. By comparison, the standard isotropic total variation involves 



a term of the form a /u^ + Uy which does not allow for a linear program reformulation, and 
leads to a more challenging optimization problem. 

Let us show how to discretize and reformulate F3 as a linear program - the functionals 
Fi and F2 can be discretized and minimized in a similar manner (in fact Fi is a special 
case of -F3, where the convolution matrix is the identity). For a given small parameter h, 
approximate the minimizer u{x, y) by a suitable (piecewise linear or piecewise constant) 
interpolation u {x,y) of a grid function U, defined on the grid with spacing h, where 
i,j = 1, . . . ,N. Here u{ih,jh) = Uij. Next, approximate the terms Ux and Uy by finite 
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differences 



Ux{ih,jh) = - (C/j+ij 
Uy{ih,jh) = - {Uij+i 



U, 



i,jj 



u, 



^,3) 



For the purpose of building matrices for the hnear operators, reindex U as a, column vector 
of length N'^. Write Dx,Dy for {h times) the matrices which correspond to the finite 
difference operators above. Similarly, the convolution operator can be approximated by 
a convolution with a discrete kernel K^. Let M^ represent the matrix of the convolution 
operator, also scaled by the factor h. The matrices Dx,Dy, Mf^ each have N'^ columns. 
They have different numbers of rows. Denote the number of rows for each matrix by 
nil, 1712, rris, respectively. Let F be the grid function which corresponds to a blurred and 
noisy vector and represent F as a column vector of length 7723. For simplicity, we use 
piecewise constant quadrature to approximate the integrals in the operator F3, and, after 
dropping a factor of h, we are left with 



F^{U) = \\D,U\\i + 



\DyU\ 



+ \h\\MkU - F\\i, 



a fully discrete convex function of the grid function U. 

To formulate the equivalent linear program, define the matrix and vector 



" D, ' 




' Ox ' 


Dy 


, b = 


Ox 


Mk 




F 



M 



Here Ox, Oy are column vectors of zeros of length mi, 1112, respectively. Using this definition, 
we can rewrite 

Fi\U) = \\MU-b\U. 

Next, changing notation slightly, (the following notation applies just to this section) we 
show how to recast the problem 

min \\Mx — b\\i 
xeM^^ 

as a linear programming problem. Define the new variable y* = (x"*" ,x~ ,x*), where 



x~^ , X are column vectors in 
the equivalent problem 



[)Af2 



and the vector e 



:i,...,i) G 



fN'^ 



. Then consider 



minimize e x~^ + e x 

j2 



Mx 



subject to 



x^ ,x > 0. 
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obtained by splitting Mx — b into a positive and negative part and summing their 1-nornis. 
This is a hnear program: It involves the minimization of the linear function (c*y), for 
c = (e*,e*,0), subject to a linear equation, and non-negativity constraints on a subset of 
the variables. 

We performed the minimization using two convex optimization packages, CVX, and 
MOSEK. Both are callable from MATLAB. The first, CVX [TS1[T7], is a package for specifying 
and solving general convex optimization problems. The second, MOSEK [21j, requires the 
user to reformulate each problem as a standard form optimization problem (in this case as a 
linear program), but it is able to solve larger problems. For the problems we presented, CVX 
was able to solve the problem in a few seconds for Fi , F2 and a few minutes for smaller 
instances of F^, MOSEK was able to solve the small instances of F3 in seconds, and the 
largest problems in a few minutes. 

8 Numerical Results 

We compared the performance of the functionals Fi applied to a number of 2D bar codes 
corrupted by some combination of noise and blurring. To produce blurred and noisy 
images, convolution with blurring kernels of variable sizes was followed by additive Gaussian 
noise. The objective was to test the conditions for which bar codes could be recovered and 
to compare the performance of the various functionals, not to optimize the numerical 
implementation. The bar code images had a resolution of either 8 x 8 or 12 x 12 pixels 
per square of size to x uj. That is, we choose h = uj/p where p is the number of pixels per 
square. In all cases, we give values for the dimensionless fidelity parameter A := Xh. 

8.1 Noisy Images 

We begin with a comparison of performance of the two functionals, -Fi and F2 on noisy 



images. We show the same noisy bar code denoised with the two methods (Figure 3). In 
each run we used A = 75 for Fi and A = 2 for F2. In contrast to Fi, minimization of F2 
resulted in a binary image (even without taking a level se1r|. We found that the functional 
F2 was robust under fairly large noise and indeed, the reconstruction is nearly perfect even 
in the presence of significant amounts of Gaussian noise. The performance of F2 is superior 
to Fi as it retains both the shape and the binary character of the image. We note that 
simply thresholding the result of Fi can introduce additional errors. 

8.2 Blurred Images 

The blurring kernel was chosen to be a piecewise linear hat function on a square. (In one 
dimension, for a given kernel radius r, the kernel is the normalization of the pixel function 



^This is no surprise if we expect the minimizers of Fi to be unique. It can also be proven directly for 
minimizers of F2 taking discrete values on a square grid. 
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(a) Noisy Image (a=.2) 




mm 



(d) Noisy Image (a=.35) 



(b) Result of Fi 



(c) Result of F2 





(e) Result of Fi 



(f ) Result of F2 



Figure 3: Comparison of denoising using Fi and F2. First row: Gaussian noise (ampli- 
tude a = .2, signal to noise ratio 18.2 dB). The reconstruction using Fi is patchy. The 
reconstruction with F2 is nearly perfect. Second row: Gaussian noise (amplitude a = .35, 
signal to noise ratio 7.0 dB). The reconstruction using Fi has deteriorated further. The 
reconstruction with F2 is correct, except for a few switched pixels. 
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(a) Original 



(b) Blurred and Noisy 



(c) result of Fs 



Figure 4: Result of F3 on a trivial bar code. Each square is 12 x 12 pixels, the blurring 
kernel radius is 12 pixels. Gaussian noise (amplitude .1, signal to noise ratio 23.0 dB). The 
reconstruction loses some contrast. 



with values (1, 2, ... r, ... 2, 1). The two-dimensional kernel is a Cartesian product of that 
one-dimensional kernel with itself.) In each run, we used A = 10 for F^. The first result 



(Figure 4) is for the bar code with a single square, blurred with a kernel whose radius is 



equal to the width of the square and with Gaussian noise added. The reconstruction has 
close to the correct shape, but has lost some contrast. The second result involves blurring 
without noise (Figure^. The third result (Figure 6) involves two different kernels. After 
thresholding, the recovered image is quite close to the original even in the presence of 
substantial noise. For the wider kernel there is some deterioration along diagonal patterns 
of squares. 

One might ask how our values for A compare with the results of our Theorems which 
basically state that if Aw > 4, then the global minimizer is the underlying bar code (i.e. if 
A > 4:/N, where A^ is the number of pixels per unit square). Comparison here is delicate 
because of the presence of noise. First off, there is an upper limit to acceptable values of 
A as large values will bring in too much unwanted fidelity to the noise. More importantly, 
in all cases we found the lower threshold value for A to be very sensitive to noise: for a 
given barcode signal, even adding noise with amplitude 10~^ increased the threshold value. 
Thus even in the simulations underlying Figure [5] which involve no externally added noise, 
numerical round-off errors can account for enough noise to change the threshold for A. This 
explains the fact that the threshold required for exact recovery was larger than predicted 
by Theorem |6.5| (by a factor of 8). A simulation with a narrow kernel, on a smaller image 
resulted in a critical value of A which was off by (the smaller) factor of 1.4. We expect that 
with wider kernels and larger problems, this value can be even more sensitive to noise. 

In conclusion, in the presence of a known blurring kernel the functional F3 followed by 
thresholding can recover close to the exact bar code for blurring kernels with diameters 



26 



s 




(a) Original 



(b) Blurred 




m^ 



(c) A = 1 



(d) A = 4 



(e) A = 8 



Figure 5: Result of -F3 with a range of values of A and no noise. Each uj x uj square is 8 x 
pixels, the blurring kernel radius is 8 pixels. 
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(a) Original (b) Blur r=8, Noise a =.02 (c) result of F-^ (d) result of F3, thresholded 
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(e) Original (f) Blur r=8, Noise a=.2 (g) result of Fg (h) result oi Fs, thresholded 





\v w 





(i) Original (j) Blur r=12, Noise a=.2 



(k) result of F3 



(1) result of Fs, thresholded 



Figure 6: Results of F^. Each square in the bar code is 12 x 12 pixels. Gaussian noise 
amplitude a is either .02 or .2. The blurring kernel radius r is 8 or 12 pixels. For the mildest 
example, the reconstruction is almost perfect. Errors observed include deterioration along 
diagonal patterns of squares or incorrect placement of the boundaries of squares. However, 
note that even the last case is not that bad given that the blurring kernel with r = 12 has 
support spread over two unit squares. 
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about 1.5 times the X-dimension and small noise. Increasing the radius of the kernel or the 
amplitude of the noise leads to errors in the recovered image. The types of errors included 
incorrect locations of boundaries of squares, or additional features along squares arranged 
in diagonal patterns. Not surprisingly, computations of blurred images (not presented) 
using Fi or F2 were less effective at recovering the bar code. 

9 Discussion 

We have presented three functionals for the L^ approximation of signals with anisotropic 
total variation regularization and applied them to the denoising and deblurring of bar 
codes. Our analytical results show that the fidelity parameter A should be chosen above 
a certain threshold in order to not get the trivial minimizer. When comparing Fi and Fi 
the analytical results in the absence of noise or blurring show that there is only a slight 
relaxation of the threshold for A to get the bar code back. The numerical experiments 
clearly show that in practical situations with noise and blurring, Fi (or actually -F2) is 
preferred since it has binary output. If the blurring operator K is known, it is even more 
advantageous to choose -F3. Our analysis shows that in the absence of noise, but with 
blurring present, we can recover the clean bar code by using F3 regardless of the precise 
form of (the known) K. The numerical experiments also show the best results for F3. 
There are several avenues for future work: 

• We have shown that the only binary signals that functionals Fi and F^ are faithful 
to are clean 2D bar codes. It would be interesting to extend this result to any signal 
in L^(E?), not just binary ones. Due to the technical difficulties introduced by the 
restriction on the admissible functions for F2 we have at present no result for F2 (or 

• The convexification method we used for Fi is not applicable to the restriction of F^ 
to Sy(R^; {0, 1}). It would be valuable to see if there is another way to incorporate 
the binary restraint into F3 apart from the a posteriori thresholding as applied in 
the numerical experiments. 

• Blind deconvolution: In practice, the blurring kernel underlying the measured 
signal / may be unknown. Future analytical work could focus on how well -F3 performs 
if the exact blurring operator is not known, and hence K is only an approximation 
of the operator hidden in the measured signal /. One possibility could be to first 
try to determine certain statistics of the unknown convolution kernel (such that its 
standard deviation) , and then use F3 with a K consisting of convolution with a fixed 
kernel possessing the same statistics. Within a Gaussian ansatz, blind deconvolution 
was addressed variationally for ID bar codes in |11] and a similar approach could 
also be adopted for 2D bar codes. 
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The numerical experiments suggest that, for certain choices of A, minimization of 
these functionals works weh with both significant noise and blurring. In the case 
of non-noisy bar codes our theorems give sufficient thresholds for acceptable values 
of A but the numerics show that these are sensitive to noise. It would therefore 
be interesting to explore whether or not one can analyze the dependence of these 
thresholds on small perturbations of the signal /. 

Nonlocal total variation: A possible alternative regularization term instead of 
anisotropic total variation is anisotropic nonlocal total variation (cf. |14l 115] ) 



\u{x) - u{y)\y/w{x,y)dxdy 

for some well chosen weight function w. Nonlocal total variation does not restrict 
itself to local information, but compares patches from all over the image and hence 
is well suited to regularize images containing recurring structures, like bar codes. 
It would be interesting to see what analysis and simulations can tell us about the 
improvement this would be over the local anisotropic total variation. 

A Properties of the anisotropic total variation 

In this appendix we collect some properties of our anisotropic total variation (II]), most of 
which follow from the analogous properties of the standard isotropic total variation which 
defines the space BV(M?): u G L^iR"^) is in the space BV(M?) iff 



/ iVul < oo where / |Vn| := sup < / udiYV : i; G C, 

JR2 J]R2 [ JlR2 



(M';M'),Vx, ||t;||oo<U. (21) 



We start by pointing out that the anisotropic total variation is an equivalent seminorm 
to the isotropic total variation defined above. 

Lemma A.l. For u G BV{M?) we have 

|Vu| < / \ux\ + \uy\ < v2 / |Vu|. 



Lemma A.l| immediately gives the following isoperimetric inequality (cf. [13", 5.6.1 



Theorem 1 (i)]). 

Lemma A. 2. There exists a constant C > such that for all u G BV{M.'^) 

C|kllL2(R2) < / \Ux\ + \Uy\. 
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The following approximation lemma allows us to replace C^ functions with L°° in the 
definition of our anisotropic total variation. 

Lemma A.3. Let v G L°°{R^;R'^) with divv G L°°{R^) and |f(x)|oo < 1, then there 
exists a sequence {vj}'^^ C C^(]R^;]R^) such that as j — )• oo, Vj -^ v in L°°{'E?;M?), and 
divvj ^ divv in L'^{R'^). That is, for all u G L'^{R'^;R'^) and w G L°°{R?), as j -^ oo, 

u ■ V and / w divvj -^ j w divv. 

In addition, for each j and all x ^Rp' , \vj{x)\oo < 1- 

Proof. The proof is very similar to [12, Proposition 3.3]. Let ^ G C^iR?) be a cutoff 
function satisfying ^ < 1, ^(x) = 1 if |x| < 1 and £,{x) = if |rE| > 2 and let rj G C^^R^) be 
the standard radially symmetric mollifier with r/ > and j^2 r] = 1. Define Vj G C^(M^; M^) 
via 

Vj{x) ■=f{^(.x/j)v{x)) *r]{jx) 

where the convolution is componentwise. One can readily check that this new sequence 
satisfies all the desired bounds on ||fj||2,oo(iR2.]K2), ||divuj||j;^ 00(^2), and |w(x)|oo- 

□ 



IS 



An immediate corollary to Lemma A. 3 
Corollary A. 4. 

\u^\ + \uy\ = sup \ / u divv -.v e L'^{R^;R^), divv e L'^{R'^),\v{x)\oo<la.e. 

(22) 

Four important properties of the standard isotropic total variation also hold for the 
anisotropic total variation: lower semicontinuity, approximation by smooth functions, the 
co-area formula, and smooth approximation to sets of finite perimeter. The proofs follow 
those of the isotropic case (cf. \lti\ Theorems 1.9, 1.17], [13, 5.5 Theorem 1], [21 Theorem 
3.42]) with the obvious modifications. 

Lemma A. 5. For every sequence {un}^=i C BV{R'^) such that Un ^>- u in L\^^{R?) as 
n — )• 00, for some u G BVi^), we have 

\ux\ + \uy\<\im\ni / \Un^\ + \UnA. 

Lemma A. 6. Let u G BV{R?), then there exists a sequence {un}.^i C C°°{R?) such that 
Un ^ u in L^(]R^) i/n — )• 00 and 



/ \^nj + \Uny\ = / \Ux\ + \Uy 
JR2 Jk2 



iim I I LUfi^ I I I u-riu I — ; I "-x I I I "-If I 
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Lemma A. 7. Let f G BV{M?) and define 

E{t) := {x G M^ : f{x) > t}. 
Then 

Lemma A. 8. If E is a set of finite perimeter in M?, then there exists a sequence {Ej}'^^ 
of open sets with smooth boundaries converging in measure to E and such that 



lim / \VxE,\ = / iVxsl and 



lim / \XE,J + \XE,\= \XEj + \XEy\- 
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